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Abstract 

We establish the existence of a deterministic exponential growth rate for the norm (on an 
; appropriate function space) of the solution of the linear scalar stochastic delay equation 

J ■ dX(t) = X(t — 1) dW(i) which does not depend on the initial condition as long as it is not 

identically zero. Due to the singular nature of the equation this property does not follow 
from available results on stochastic delay differential equations. The key technique is to 
establish existence and uniqueness of an invariant measure of the projection of the solution 
onto the unit sphere in the chosen function space via asymptotic coupling and to prove a 
Furstenberg-Hasminskii-type formula (like in the finite dimensional case). 
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1 Introduction 



Let W(t), t > be linear Brownian motion defined on some probability space (fl, J 7 , P). 
In this paper, we will study asymptotic properties of the stochastic delay differential equation 
(SDDE) 

dX(t) = X(t-l)dW{t), X = r], (1.1) 
where r\ G C := C([— 1, 0], R), and for t > 0, we define 

X t {s) :=X(t + s), sE [-1,0]. 

For a fixed chosen norm | . | on C we will be interested in the question whether for the C-valued 
solution X t of the SDDE (fTTTT) the limit 

\{r],u) := lim -log||X t (w)|| 

i->oo t 
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exists almost surely for each 77 6 C and is deterministic and independent of rj as long as rj ^ 0. 
We will show in our main result (Theorem ll.il) that there exists a deterministic number A G R 
such that for every r] ^ we have \(r),ui) = A almost surely. In this case, we call A the 
exact exponential growth rate of (11.11) . To prove Theorem 11.11 we follow the path paved by 
Furstenberg [3J and Hasminskii [6] (see also fl]|) in the finite dimensional case: project the 
solution of the equation to the unit sphere of an appropriate function space and show that the 
induced Markov process has a unique invariant probability measure fi. Then make sure that 
for each initial condition on the sphere the empirical measure converges to /x and represent 
the exponential growth rate as an integral with respect to /j as in the classical Furstenberg 
formula. While the existence of /i is rather easy to show, uniqueness is more involved. We 
follow the strategy developed in 01 to show uniqueness of /i. Contrary to flU we have to deal 
with degenerate equations here requiring a modification of the approach. 

Let us first justify our restriction to such a simple equation as (ll.ll ). In spite of its simplicity, 
the equation is known to be singular in the sense that there does not exist any modification of 
the solution which almost surely depends continuously upon the initial condition i] with respect 
to the sup-norm (see [8J). In particular, the results in [|9l establishing a Lyapunov spectrum 
and a corresponding decomposition of the state space for a large class of regular linear SDDEs 
cannot be applied. 

Since equation (|l.ll) is the simplest possible singular stochastic delay equation, we believe 
that it is worthwhile studying its asymptotics in some detail. We are optimistic that in principle 
our method of proof can be generalized to a large class of (multidimensional) linear stochastic 
functional diffential equations but we expect the proofs to be quite a bit more technical. 

Clearly, equation (11.11 ) has a unique solution for each initial condition X = r\ G C and the 
process X t , t > is a (strong) C— valued Markov process with continuous paths. We define 
the following norms on C: Let ||.|| 2 be the L 2 -norm, |.| the sup-norm, and |||.||| the M 2 -norm 
defined as 

Ill/Ill 2 := (Z(0)) 2 + f{f{s)?As 

(the Hilbert space M 2 consists of all functions from [— 1, 0] to R for which this norm is finite). 
Our main result in this paper is the following: 

Theorem 1.1. There exists a number A G R such that for each rj G C\{0}, the solution X of 
equation (11.11 ) with initial condition rj satisfies 

lim \ \og\\X t (u)\\ = lim \ log \X t {u)l = A a.s.. 

It is easy to see (and will follow from Lemma [2TI) that for each rj ^ 0, the process X t 
starting at X = r] will almost surely never become (identically) zero. Therefore, the process 

S t :=X t /\\X t l t>0 

is well-defined. Since our equation (11.11) is linear, the process St, t > is a Markov process 
with continuous paths (with respect to both the sup-norm and the M 2 -norm on C) on the unit 
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sphere of M 2 . We will show that this process has a unique invariant probability measure fi. 
Suppose for a moment that this has been shown. Then, by Ito's formula, we have 

d\\X t f = X\t) dt + 2X(t)X(t - 1) dW(t) = \\X t f (/(|^| )<tt + 9(^£jdW(t)) , 

where f{rj) = r] 2 (0) and g{rj) = 2t](0)i](— 1). Hence, 




Therefore, by Birkhoff's ergodic theorem, 

1 f 1 1 

lim - log \\X t \\ = / -/ (77) - -g 2 (ri) d/ifa) =: A a.s., (1.2) 

i-s-oo t J Z 4 

for /i-almost every initial condition X = 77 since / is bounded (and g 2 is non-negative) and 
since the stochastic integral is asymptotically negligible compared to its quadratic variation 
unless the latter process remains bounded as t — > 00 in which case the stochastic integral 
remains bounded in t as well and therefore does not contribute towards the limit in (11.21) . This 
is almost everything we want to show except that we want to ensure that the limit exists almost 
surely for each initial condition 77 and not just for /i-almost every 77. Since / is bounded, it 
follows that A < 00 (in fact A < 1/2) but it is not immediately obvious that A > —00. This 
follows however from the following result which is Theorem 2.3. in IfTOl . 

Proposition 1.2. There exists a real number Ao such that for every rj 6 C\{0}, we have 
Pjliminf^oo | log |||X t ||| > A } = 1, where X solves (11.11) with initial condition 77. 

Note that as a consequence Proposition ! 1.2[ it follows that the function g is square integrable 
with respect to fj,. 

It is easy to see that then, we also have 

lim - log \\XA\ = A a.s., 

t—¥00 t 

since 

llXtll < V2\\X t \\ < V2 sup |||A: s ||| 

t-l<s<i 

for all t > 0. 

In order to prove Theorem ll.il it therefore remains to prove existence and uniqueness of an 
invariant probability measure fj, of the Markov process S t , t > and to show that (11.21) holds 
for each initial condition 77 G C\{0}. 

We will need the following result which is Step 1 in the proof of Theorem 2.3 in ifTOll . 

Proposition 1.3. There exists a real number K such that for every r/ E C, we have E(|||Xi||| _1 / 2 ) < 
i^|||77||| -1 ' 2 , where X solves (11.11) with initial condition 77. 

Upper and lower bounds for the exponential growth rate A have been obtained (even for 
equations with an additional factor a in front of dW(t)) in IfTOl and 0T| (in those papers the 
existence of the limit (11.21) was not yet known: the authors obtained upper deterministic bounds 
for the lim sup and lower deterministic bounds for the lim inf ). 
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2 Existence of an invariant measure 



In this section, X is always the solution of equation (|l.ll) - possibly with a random initial 
condition which is independent of the a— algebra generated by the driving Wiener process W. 
Let T t , t > be the filtration (right-continuous and complete) generated by the initial condition 
and the Wiener process W. We will always assume that the initial condition satisfies E||X || 2 < 
oo which ensures that all moments appearing below will be finite and conditional expectations 
well-defined. As before, we define S t := X t /l\X t \\. We need the following lemmas. 

Lemma 2.1. There exists some C\ > such that for each t > 1 and a > Owe have 

P{\X(t)\ < «|Xi_ 1 ||j : ;_ 1 } < Cl aa.s.. 

Proof. Let N be a standard normal random variable. Abbreviate a :— X(t — 1), a :— \\X t -i ||2- 
Then, for a < 1/2, 

P{|X(0|<a|||X t _ 1 ||||.F t _ 1 } 

= P{\X(t-l)+ [ X(s-l)dW(s)\ <ap t _ 1 |||.F t _ 1 } 
Jt-i 

< P{\a + aN\ < a(\a\ + a)\T t -i} 

< supP{X e[x- a(x + l),x + a(x + 1)]} 

x>0 

< sup |2a(x + 1) exp { (((1 — a)x — «) + ) 2 } | 

< asup(2(x + l)^=exp{ - -((x - 1) + ) 2 }) 
~ x>o I V27T 1 4 VV J J 

= ca, 

since the supremum is finite. Defining c\ := c V 2, the assertion follows. □ 
Lemma 2.2. For eac/z t > 1 and each Tt-i-measurable positive random variable £, we have 



^-i} < i(^ 2 (^ - 1) + 4||X t _ 1 || 2 ) < ^|||^t-i||| 2 fl-J.. 



Proof. Using Doob's L 2 -martingale inequality, we get 



•Ft-i} < ^EdlXtflF^) < ^(X 2 (t-l)+4||Xi_ 1 || 2 ) < ^|||X t _ 1 ||| 2 a.s.. 



□ 



We regard the process S t , t > as a Markov process with state space C defined as the 
intersection of C and the unit sphere of M 2 equipped with the supremum norm ||.||. Then 
St, t > is a Feller process with values in the Polish space C (with complete metric induced by 
the supremum norm). 
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Proposition 2.3. For any (possibly random) C-valued initial condition X which is nonzero 
almost surely, the laws C(S t ), t > 2 are tight in C. 

Proof. Let M := {C(S t ), t > 2}. By the Arzela-Ascoli Theorem, we have to show that 

(i) lim^oo sup ueM v{{f E C : |/(0)| > a}) = 

(ii) For every e > we have 

hm sup u({f e C : sup{|/(*) - : s,t G [-1, 0], |t - s| < 5} > e}) = 0. 

(i) holds since P{|S t (0)| > a] = P{|X(t)|/||X t || > a} = whenever a > 1 and t > 0. 
It remains to verify (ii). Fix t > 2. For a, <5, e > we have 

P{ sup |5 t («)-5 t (s)|>e}=P{ sup |if( u )-if(s)|>e||X t ||) 

^ -l<s<u<0,u-s<<5 ' 0<s<w<l,u-s<5 J 

<P{ sup |if(«)-if(s)| >ea||X t _i||} + p{||X t || <a||X t _i||}, 

^ 0<s<u<l,u-s<(5 J ^ J 

where 



if (r) := 



t-l+r 



l)dW(u), r > 



t-i 



is a local martingale which has a representation if (r) = B(r(r)) for a Brownian motion 5 
which is independent of T%-\, where 



»t-l+r 



r 

r(r) = / X 2 {v- l)dv, r > 0, 

soO < r'(r) = X 2 (t-2 + r) < ||X t _i || 2 for r G [0,1]. Hence 
P{ sup \H(u) - H(s)\ > ea\\X t ^\\ T t A 

^ 0<s<u<l,u-s<5 > 

<P{ sup (B(\\X t ^\\ 2 u) - (B(\\X t ^\\ 2 s) >ea\\X t ^\\ F t -i\ 

^ 0<s<u<l,u-s<8 i 

= P{ sup \B(u) - B(s)\ > ea). 

^ 0<s<u<l,u-s<6 ' 



Further, 



p{||X t || < aWXt^W^j < p[\X(t)\ < aWXt-^Ft^} 

< P{\X(t)\ < a^WX^W^} + P{|||X t _ 1 ||| < a^WXi 
+ p{|||X^ 2 |||<a 1 /3|| Xt _ i |||^_ 2 | 

<a 1 / 3 c 1 + a 1 / 3 c 1 +4a 2 / 3 , 



t-2 



where we used Lemma[2j](for the first two summands) and Lemma |Z21 (for the last summand) 
in the final step. For fixed a, e > we obtain 

limsup sup v{{f G C : sup{|/(t) - f(s)\ : s,t G [-1,0], \t - s\ < 8} > e}) 

54.0 veM 

= limsup sup P< sup \S t (u) — S t (s)\ > e> 

610 t>2 L -l<s<u<0,u-s<6 J 

< 2ci« 1/3 + 4ct 2/3 . 

The assertion follows since a > can be chosen arbitrarily small. □ 

Remark 2.4. The proof of the previous proposition shows that tightness holds even uniformly 
with respect to the initial condition, i.e. the family C(S t • ), t > 2, r] 6 C\{0} is tight. Clearly, 
the family C(S t ), t > is also tight for each fixed initial condition i] E C\{0} but not uniformly 
with respect to 77. 

Proposition 2.5. The C— valued Markov process S t ,t>0 has an invariant probability measure 
fi. 

Proof. This follows from the Krylov-Bogoliubov theorem (see 0, Theorem 3.1.1) by Proposi- 
tion [2]3] and the fact that the process St, t > is Feller. □ 

For later use, we formulate the following straightforward corollary of Lemma 12.11 and 
Lemma [2T2l 

Corollary 2.6. For 7 > and t > 1, we have 

P(\X(t)\<j\\X t \\\T t -i) < Cl VT + 4 7 a.5.. 
The previous corollary immediately implies the following one. 
Corollary 2.7. There exists some C2 G (0, 1) such that for every t > 1, we have 

P{W*(\\X t \\l) < ^X^W^} > c 2 a.s., 

where W is a Wiener process which is independent of Ft and W*(s) := sup ug [ s i | W(u) \. 



3 Uniqueness of an invariant measure 

Consider 

dX(t) = X(t-l)dW(t) 



dY(t) = Y(t- l)dW(t) + Xp(t)(X(t) -Y(t))dt, (33) 

where p is an adapted process taking values in {0, 1} such that p is constant on each inter- 
val [n, n + 1), n G N . We will show that p can be defined in such a way that for any 
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pair of deterministic initial conditions (X ,Y ), the process Z{t) := X(t) — Y{t) satisfies 
limA-5>oo limsup^oo | log \\Z t \\ = — oo almost surely and such that the law of Y is absolutely 
continuous with respect to the law of the solution of dY(t) = Y(t — 1) dW(t) with the same 
initial condition as Y provided that A is sufficiently large. Then, we project both X and Y to 
the unit sphere C and show that the distance between the projected processes converges to as 
t — > oo for large enough A. Then we apply Corollary 2.2 in 01 and obtain uniqueness. 

Observe that the choice p = 1 in (13.31) will not work: Y will not be absolutely continuous 
with respect to Y since it can happen that at some (random) time Y(t) is zero and Z(t) is not 
and then the additional drift prevents Y from being absolutely continuous with respect to Y . To 
prevent this, we will switch off p when this happens. Roughly speaking, we will switch p on 
as often as possible (thus guaranteeing that Z converges to sufficiently quickly) but we will 
switch p off whenever Y has not been bounded away from zero sufficiently during the past unit 
time interval. We will always assume that the initial conditions X and Y are almost surely 
different which implies that the process Z t will almost surely never hit zero. 

To define p, let 

B:={feC: f(s)^0 for alls G [-1,0] and inf > \ sup 

s6[-l,0] I se[-l,0] 

Further, let k > be such that ci^/k + An < y (where c\ and C2 were defined in Lemma I2T1 
and Corollary [277] respectively) and define 

R:= {/eC:*||/||< |/(0)|} 

(R stands for reasonable) and 

A n := {Y n G B} PI {Z n G R}, n G N . 

We define pit) = 1 on [n, n + 1) if A n occurs and pit) = otherwise. The following lemma 
shows that the conditional laws of the waiting times between successive A„'s have a geometric 
tail (uniformly in A). 

Lemma 3.1. For all n G N, n > 2, and all A > 0, 

P{A n U A n _i|J r n _ 2 ) > y on A c n _ 2 a.s. 
Proof. On the set A c n _ x , we have 

P{r„ G B\ > P{ sup | / Y{u-l)W{u)\ < i|K(n-l)||JV-i} 

se[n~l,n] Jn-1 " 

= P{W*{\\Y n ^\\ 2 2 ) < ±\Y{n - l)||J-„-i}, 

ia nd W*(t) := sup sem \W(s)\. 
2 } > c 2 a.s.. 



where W is a Wiener process which is independent of J> 
Corollary 12.71 shows that 

P{W*(\\X n ^f 2 )<^\X(n-l)\\^ 
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Therefore, on A c n _ 2 , we have 



P({Y n g B}uA»-i|J r «-2) 

= P({K„ eB}n A c n _ x \^ 2 ) +P(A n . 1 \T n _ 2 ) 

= v(p({Y n G B}\T n ^)l A c n i \T n _ 2 ^ +p(A ri _ 1 |j;_ 2 ) 



>c 2 . 

Further, on A c n _ x , by Corollary I2.6L 



P({Z n g = P{{Z(n) > K||Z n ||}|7"„-i) 

c 2 



> 1 - ciV^ - 4/c > 1 } 



Hence, on A£_ 2 , we have 



P({Z n ei2}UA»-l|^n-2) 

= P({z n eR}n A^lTn-z) + P(A n _i| J- n _ 2 ) 

= e(p({z„ g i2}|j- n _i)i A c_jj;_ 2 ) +p(A n _!|j- n _ 2 ) 

> (1 - |)p(^_ x |j;- 2 ) + p(a^iI ^- 2 ) 

> 1- — . 

2 

Therefore, on A c n _ 2 , we have 

P(A n U A»-i| ^-2) > c 2 + 1 - c 2 /2 ~ 1 = y, 

which is the assertion. □ 

We now have to show that whenever we have an interval [n, n + 1) on which p is one, then 
with high probability |||Z n+ i||| is much smaller than |||Z n ||| (when A is large). More precisely, the 
following lemma holds. 



Lemma 3.2. We have 



E (%fl^) <2(r(A)) 1 / 2 on A r , 



\Z n 



and 

for A > and 
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Let A := -%2 (which implies r(A) < I for X > X ). Then, for a > 0, n G N , and X > A , we 
have 

P{t\Z n+3 \i > a\\Z n \l\T n } < 3a- 2 / 3 r(A) 1 / 3 + (l - | ) ((6«- 2/3 ) A l) a.s.. 

Proof. On A n = {Y n e B} n {Z n G R}, we have for a > and A > 

1 



P{IK+i||| > LFJ < 



« 2 III 1 2 



1 



< 



« 2 |^n| 2 

Z 2 (n) 



r (A) < — r(A), 
cr 



E(|||Z n+1 ||| 2 |j- n ) 

1 ,\ _ e -2A(l-«) 



2A 



« 2 III^III 2 

since k < 1. Therefore, on A n = {F n G 5} fl {Z„ G -R}, 

1ll^n + l| 



e -2A(l-„)j z 2 (n _ 1+M)dM 

(3.4) 



E 



\^)=l P {l Z «+ilI >a|ll^n||||^n}da<^ (l A ^) da = 2(r(A)) 1 / 2 . 



Further, on = ({K„ e B} n {Z n G i?}) c , we have for a > 



P{|||Z n+1 ||| > a|||Z n ||| |7- B } < -— E ( HI HI 2 1 J^) 

a III I 

2Z 2 (n) + ||Z 112 



nN2 -r / (l-n)Z 2 (n-l+ M )dM <^. 
o 7 « 



(3.5) 



Hence, 



E 



(^irl^n) = /"Pil^+il > a|Z„| I T n } da < 2^2. 

V III Z « III J JO 



It remains to prove the final assertion. Using (13.41) and (13.51) we see that on A n we have 



r , i in Z n +3 . 

Ps „, „ in > a 



+ P 



FA < P 



ra+2|| 



> ^^^(A))- 1 / 6 



v n+2|| 



> a 1/3 (r(A)) 



-1/6 



■^ra+llll 

< 5«- 2 / 3 r(A) 1 / 3 . 



n+l| 



> a^r(X) 1 / 3 



Using (13.41) and (13.51) we see that on A c n we have 



y n+3 1| 



> a 



Arguing the same way and using Lemma I3TT1 (which implies P(A n U A n ^i U A n _ 2 \J- n -2\ > 
c 2 /2), we obtain 



> a 



which implies the assertion. □ 
Lemma 3.3. For A > 0, we have 

1 C 2 

limsup - log \Z(t)\ < — log r (A) + log 2 a.s.. 

Proof. Define 

K„:=log%±ji neN , 

III Ailll 

and 

C/ n := 1^, n G N . 
Then, by Jensen's inequality and Lemma [3T2l we get 

E(K|^n) < f/^logr(A) + (1 - f/ n )^log2 + log2, 

so 

(yi - -(Ui logr(A) + (1 - UA log 2 + log 2)) 

i=0 

is a supermartingale. Due to (13.41 ) and (13.5b , the strong law of large numbers for martingales 
(EDl, Theorem 2.19) implies 

1 N 1 

lim sup — J2(Vi-- (U { log r(A) + (1 - 17*) log 2 + log 2) ) < 0. 

7V->oo iv . „ \ Z / 
i=0 

Hence, 

1 N 1 N 

limsup — VV« < limsup — V] (C/jlogr(A) + (1 - f/^) log 2 + log 2) 
iV->oo jV r - r N->oc ^iV r ; 

which, using Lemma IBTT] is at most | log r (A) + 2 log 2) almost surely. Hence, 

1 c 2 
limsup — log I Z n I < — logr(A) + log2 a.s.. 

n—toc n* 12 

To obtain the assertion, it suffices to show (thanks to the first Borel-Cantelli Lemma) that for 
each 5 > the sum over P{ || Z n+1 \\ > e 5n ||| Z n ||| } is finite which is easily established by estimat- 
ing the corresponding conditional probabilities (conditioned on 7 n ) like in the proof of Lemma 
13 .21 This proves the assertion. □ 
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Lemma 3.4. There exists some Ai > such that for all A > Ai, the law of the process Y is 
absolutely continuous with respect to that of the solution of (11.11) with the same initial condition 
as Y (Ai does not depend on the initial condition of (Xo, Yq) ). 



Proof. We need to make sure that for A sufficiently large, we have 

Z\t) 



Y*(t-i; 



dt < oo 



a.s. 



(3.6) 



Then, the assertion follows from Girsanov's Theorem (see 0, Chapter 7). By the definition 
of p, we have Y 2 (t) > j\\Y n \\ 2 whenever t E [n — l,n] and p(n) = 1 (which is equivalent to 
p(s) = 1 for all s E [n,n+ 1)) which implies 



Z\t) 



Y 2 (t 



oo 

' n=l 1 



J n\\2 



Y n -i\ 



(3.7) 



Let A be as in Proposition 11.21 Then liminf^oo jlog||X t || > A almost surely for each 
initial condition 77 ^ 0. By Lemma [331 we find Ai > such that for all A > Ai, we have 
limsup^oo ~ log \Z(t)\ < (2A ) A (— 1). Then liminf^oo ~ log ||F t || > A which, together 
with equation (13.71 ), implies (13.61) . □ 

Proposition 3.5. The Markov process S t '■= X t /\\Xt\\, t > has a unique invariant probability 
measure p. The support of p is C. 



Proof. Existence of an invariant probability measure p has been shown in Proposition 12.51 To 
establish uniqueness, observe that 



Y, 



Y 



< 



X t -Y t 



\\Xt 



+ Y t 



X, 



< 2- 



(3.8) 



which converges to zero exponentially fast as long as A is sufficiently large. Lemma [3~4l to- 
gether with the fact that absolute continuity of measures is preserved under measurable maps, 
shows that the law £(Y^/||Yi|, t > 0) is absolutely continuous with respect to t > 

0), where Y solves equation (ll.lt with the same initial condition as Y. Now uniqueness follows 
from Corollary 2.2 in 01 . 

It remains to show that p has full support. Let X solve (ll.lt with initial distribution p. 
Let G be a non-empty open subset of C. We show that p(G) > 0. Assume that G contains a 
function / such that /(0) > (otherwise the proof is completely analogous). Let B + be the set 
of positive functions in B. It follows as in Lemma [3TT1 that X n visits B + infinitely often almost 
surely. If X n E B + , then Pj^+i E G^} > and therefore p(G) > 0. □ 



4 Proof of Theorem 1.1 



In order to complete the proof of Theorem 11.11 we need to show that (1 1 .21) does not only hold 
for /i-almost every initial condition but for every initial condition in C. To establish this, we 
prove the following lemma. 
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Lemma 4.1. There exists some A 2 > such that for each <f> G C and each A > A 2 the following 
holds. Let r] G C and let (X, Y) solve (13.31) with initial condition (rj, 0). Define p and Z as 
before. Then 

r-oo Z 2 (i) 

I P(t)TFf { 7T dt — > m probability as \\rj — — >■ 0. 

Proof. As in the proof of Lemma l3~4l we get 

f*^« ^ 

u v ' n=l 11 11 n=l 111 111 

First, we estimate the numerator in the sum from above. For A > A (defined in Lemma [3T2T ). 
let U\ be a random variable satisfying 

P{U X > a} = (sa-^riX) 1 / 3 + (l - |) ((6«^ 3 ) A l) J A 1, 

for a > 0. Note that E[Aj /3 < Ef/^ 3 < oo. Define c 3 := 1 - c 2 /4. For each 5 > 0, we can 
find some 7 G (0, 1/3] and some A 2 > A for which Ef/ 7 " < c 3 exp{— 37 5}. For m G N, 
let T m := log (||^3mi/|^3(m-i)|)- Then Markov's inequality and the last part of Lemma 13 .21 
imply for C > 0: 

k 

Z3k\ie 3kS ) > C) = P{ T m + log 1^0 1 > logC - 3M} 

m=l 

k 

< C" 70 |Zo|| 7o e 37oM E^ Y[ E(e 7 ° rm |j'; 



3(m-l) 



m=l 

k 



< C" 70 |||Zo||| 7o e 37ofc<5 ^E(f/ 7 °) 

< C~ 70 |||Zo||| 70 c^. 
For i = 1, 2, we obtain in the same way 

P{(|||^3fe+i|||e 3M ) >C}< C^EIZJ 70 ^ < C" 70 2 70 |||Z ||| 70 4. 

Hence, 

oo 

P{ sup (|||Z fc |||e fc5 ) > C) < VP{|||Z fc |||e fc5 > C) 

fceNo fc=0 

< C- 70 (2e 25 ) 70 C3 2/3 |||Zo||| 70 (l - cj 3 )- 1 . (4.10) 
Now, we estimate the denominator in (I4.9I ). Observe that for A, f3 > 

P{ir OT || < A^ m } < P{l\X m \\ < \abT^} + P{\\Z m \\ > |e^ m }. (4.11) 
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Using Proposition II .31 we get 

3 



{ iix m |i <\Asr*») = p{iiix m |- i/2 > qA^ m )- i/2 } 



(4.12) 



which decays exponentially fast provided that j3 is sufficiently large. Fix such a (3 > and let 
8 := 2/3. Using (14TT01) . (I4TTT) . and (14121) . we get 



P{ Jgf (|||F m |||e m/3 ) < A} < ^ P{|||y m |||e m/3 < A} < qA 1 / 2 + cgA-w^ol 

meN ° m=0 



70 



(4.13) 



where C4, C5 are constants which depend on /3 and 70 (which are fixed) but not on A. Choosing 
A sufficiently small and C even smaller, we see from (14.101) and (14.131) that for |||Zo||| small 
enough the right-hand side of (14.91) is as small as we like with a probability as close to one as 
we like. This proves the lemma. □ 

Proof of Theorem 11.11 We have established existence and uniqueness of an invariant proba- 
bility measure fi of the Markov process S t , t > on C in Proposition 13.51 Let /, g and A be 
as defined in ( 11.2I ). It remains to show that for each initial condition 77 G C\{0} (or 77 G C) 
the solution X of equation (11.11) satisfies (11.21) . Let Ai C C be the set of initial conditions 
for which the empirical distribution of S t , t > converges to /x weakly almost surely and for 
which lim^oo \ jjj 



Jo 9 2 {S S ) ds = J g 2 d/i holds almost surely (the second condition does not fol- 



low from the first since g 2 is unbounded but lim^oo | J Q f(S s ) ds = f f d[i does since / is 
bounded and continuous). Once we have shown that Ai = C then Theorem 11.11 follows . 



Step 1: We show that there exists some A 3 > such that for each pair (77, 0) of distinct non-zero 
initial conditions, the solution (X, Y) of (13.31) with A > A3 satisfies 



\Y III 2 



\\xsl 2 



(i.e. lim^^ {g 2 {Y s /\Y s l) - g 2 {X s /\\X s \)) = 0) and 



lim 

s— >oo 



x x 



\Y\ 



IX, 



a.s.. 



Replacing Y by X — Z, we get 

•Y(s-l)y(s)\2 - l)X(s)\2 



(4.14) 



(4.15) 



lini 2 / V |||X S ||| 2 
(X(s-l)X(s)) 2 (l\X s r-\lY s r)+A(s) 

linil 4 |x s || 4 

where A(s) is a polynomial of degree 8 of the variables |||X S |||, \\Y S \\, X(s), X(s — 1), Z(s), 
and Z(s — 1) such that each summand contains either Z(s) of Z(s — 1) at least once. Choosing 
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A sufficiently large, Z decays to zero with an exponential rate as large as we desire by Lemma 
13.31 Since we also have a priori upper and lower bounds for the exponential decay of X (and 
hence ofF), we see that Hindoo 74(s)/(|||y s ||| 4 |||X s ||| 4 ) = for large enough A. The same is true 
for the remaining term: just apply the formula a 4 — b A = (a — b) (a 3 + a 2 b + ab 2 + b 3 ) with 
a = If X s I and b = \\Y S \\. Clearly, (14.151) also holds for sufficiently large A (cf. (13.81) with the 
outer |||. I replaced by the sup-norm). Therefore, there exists some A 3 > such that (14.141) and 
(14.151) hold for every A > A 3 . 

Step 2: Fix an initial condition <p E C and denote the solution of (11.11) with initial condition <p 
by Y. We will show that <\> E M. Let A > A 3 with A 3 as defined in the first step. We know that 
yu(.M) = 1 by Birkhoff's ergodic theorem and the fact that g 2 is /i-integrable (cf. the statement 
after Proposition 1 1.21) . From Proposition [33] we know that the support of [i is C, so Ai is dense 
in C. For a given A > A 3 and e > 0, applying Lemma |4~T1 we can find some r\ E M. such that 
for 

V := J [vis)) ds, where v(s) := Y ( s -1) ' 
we have P{V < 1} > 1 — e. Define the stopping time 

r:=inf jw>0:^ w 2 (s)ds>l|, 

and let Y solve 

dY(t) = Y(t - 1) dW{t), Y = <j), (4.16) 

where 

tAr 



Pt/\T 

W(t) := W(t) + / v{s)ds. 
Jo 



By the Cameron-Martin-Girsanov Theorem, W is a Wiener process with respect to the measure 
P defined as dP(u;) = U(u)dP(u), where 

U:=exp\-[ v{s)dW{s)-l I v 2 (s)ds\. 

By uniqueness of solutions of (14.161 ), Y and Y agree almost surely up to r. In particular, 
P{Y = Y} > 1 — e. Let re J denote the set of all to for which the empirical distribution of 
Y t / 1 Y t |||, t > converges to // weakly and the corresponding integrals of g 2 converge as well. 
We want to show that P(T) = 1 (which is equivalent to G Ai). Let T be the subset of those 
h E C[— 1, oo) for which the empirical distribution t^ 1 J * 5h 3 ds of h converges to [i weakly as 
t — > oo and the corresponding integrals of g 2 converge as well. We have 

- ~ ~ f dP 

p(n = p{y e n = p{y en = j v^-jp = Hhrm 11 ) 

< (P{Y £ f}) 1/2 (EU 2 ) 1/2 < {P{Y £ f } + e) 1/2 (Ef/ 2 ) 1/2 = e 1 ' 2 (EU 2 ) 1/2 , 
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where P{Y ^ f } = follows from Step 1. The second moment of U is easily seen to be 
bounded by a universal constant. Since e > was arbitrary, we get P(T) = 1, so the assertion 
of Step 2 follows and the proof of Theorem ll.ll is complete. □ 
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